AB_NYC_2019

Dataset statistics

Number of variables	16
Number of observations	48895
Missing cells	20141
Missing cells (%)	2.6%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	23.5 MiB
Average record size in memory	503.0 B

Variable types

Numeric	10
Categorical	6

Alerts

`name` has a high cardinality: 47905 distinct values	High cardinality
`host_name` has a high cardinality: 11452 distinct values	High cardinality
`neighbourhood` has a high cardinality: 221 distinct values	High cardinality
`last_review` has a high cardinality: 1764 distinct values	High cardinality
`id` is highly correlated with `host_id`	High correlation
`host_id` is highly correlated with `id`	High correlation
`number_of_reviews` is highly correlated with `reviews_per_month`	High correlation
`reviews_per_month` is highly correlated with `number_of_reviews`	High correlation
`id` is highly correlated with `host_id`	High correlation
`host_id` is highly correlated with `id`	High correlation
`number_of_reviews` is highly correlated with `reviews_per_month`	High correlation
`reviews_per_month` is highly correlated with `number_of_reviews`	High correlation
`number_of_reviews` is highly correlated with `reviews_per_month`	High correlation
`reviews_per_month` is highly correlated with `number_of_reviews`	High correlation
`id` is highly correlated with `host_id`	High correlation
`host_id` is highly correlated with `id`	High correlation
`neighbourhood_group` is highly correlated with `latitude` and 1 other fields	High correlation
`latitude` is highly correlated with `neighbourhood_group` and 1 other fields	High correlation
`longitude` is highly correlated with `neighbourhood_group` and 1 other fields	High correlation
`last_review` has 10052 (20.6%) missing values	Missing
`reviews_per_month` has 10052 (20.6%) missing values	Missing
`minimum_nights` is highly skewed (γ1 = 21.82727453)	Skewed
`name` is uniformly distributed	Uniform
`id` has unique values	Unique
`number_of_reviews` has 10052 (20.6%) zeros	Zeros
`availability_365` has 17533 (35.9%) zeros	Zeros

Reproduction

Analysis started	2022-02-22 06:49:52.252690
Analysis finished	2022-02-22 06:50:14.578188
Duration	22.33 seconds
Software version	pandas-profiling v3.1.0
Download configuration	config.json

id
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
UNIQUE

Distinct	48895
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	19017143.24

Minimum	2539
Maximum	36487245
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	382.1 KiB

Quantile statistics

Minimum	2539
5-th percentile	1222382.7
Q1	9471945
median	19677284
Q3	29152178.5
95-th percentile	35259101.2
Maximum	36487245
Range	36484706
Interquartile range (IQR)	19680233.5

Descriptive statistics

Standard deviation	10983108.39
Coefficient of variation (CV)	0.5775372383
Kurtosis	-1.227748342
Mean	19017143.24
Median Absolute Deviation (MAD)	9908242
Skewness	-0.09025737546
Sum	9.298432185 × 10¹¹
Variance	1.206286698 × 10¹⁴
Monotonicity	Strictly increasing

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
2539	1	< 0.1%
25583366	1	< 0.1%
25551687	1	< 0.1%
25552076	1	< 0.1%
25554120	1	< 0.1%
25568873	1	< 0.1%
25571627	1	< 0.1%
25572892	1	< 0.1%
25580113	1	< 0.1%
25580283	1	< 0.1%
Other values (48885)	48885	> 99.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
2539	1	< 0.1%
2595	1	< 0.1%
3647	1	< 0.1%
3831	1	< 0.1%
5022	1	< 0.1%
5099	1	< 0.1%
5121	1	< 0.1%
5178	1	< 0.1%
5203	1	< 0.1%
5238	1	< 0.1%

Value	Count	Frequency (%)
36487245	1	< 0.1%
36485609	1	< 0.1%
36485431	1	< 0.1%
36485057	1	< 0.1%
36484665	1	< 0.1%
36484363	1	< 0.1%
36484087	1	< 0.1%
36483152	1	< 0.1%
36483010	1	< 0.1%
36482809	1	< 0.1%

name
Categorical

HIGH CARDINALITY
UNIFORM

Distinct	47905
Distinct (%)	98.0%
Missing	16
Missing (%)	< 0.1%
Memory size	4.4 MiB

Hillside Hotel	18
Home away from home	17
New york Multi-unit building	16
Brooklyn Apartment	12
Private Room	11
Other values (47900)	48805

Length

Max length	179
Median length	37
Mean length	36.91114794
Min length	1

Characters and Unicode

Total characters	185
Distinct characters	1
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	47260 ?
Unique (%)	96.7%

Sample

1st row	Clean & quiet apt home by the park
2nd row	Skylit Midtown Castle
3rd row	THE VILLAGE OF HARLEM....NEW YORK !
4th row	Cozy Entire Floor of Brownstone
5th row	Entire Apt: Spacious Studio/Loft by central park

Common Values

Value	Count	Frequency (%)
Hillside Hotel	18	< 0.1%
Home away from home	17	< 0.1%
New york Multi-unit building	16	< 0.1%
Brooklyn Apartment	12	< 0.1%
Private Room	11	< 0.1%
Loft Suite @ The Box House Hotel	11	< 0.1%
Private room	10	< 0.1%
Artsy Private BR in Fort Greene Cumberland	10	< 0.1%
Beautiful Brooklyn Brownstone	8	< 0.1%
Private room in Brooklyn	8	< 0.1%
Other values (47895)	48758	99.7%
(Missing)	16	< 0.1%

Length

Histogram of lengths of the category

Value	Count	Frequency (%)
in	16752	5.6%
room	10038	3.4%
	8430	2.8%
bedroom	7601	2.5%
private	7158	2.4%
apartment	6695	2.2%
cozy	4991	1.7%
apt	4618	1.5%
brooklyn	4049	1.4%
studio	3988	1.3%
Other values (12552)	224301	75.1%

Most occurring characters

Value	Count	Frequency (%)
	185	100.0%

Most occurring categories

Value	Count	Frequency (%)
Control	185	100.0%

Most frequent character per category

Control

Value	Count	Frequency (%)
	185	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Common	185	100.0%

Most frequent character per script

Common

Value	Count	Frequency (%)
	185	100.0%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	185	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
	185	100.0%

host_id
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	37457
Distinct (%)	76.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	67620010.65

Minimum	2438
Maximum	274321313
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	382.1 KiB

Quantile statistics

Minimum	2438
5-th percentile	815564.1
Q1	7822033
median	30793816
Q3	107434423
95-th percentile	241764600.2
Maximum	274321313
Range	274318875
Interquartile range (IQR)	99612390

Descriptive statistics

Standard deviation	78610967.03
Coefficient of variation (CV)	1.162539998
Kurtosis	0.1691057556
Mean	67620010.65
Median Absolute Deviation (MAD)	27543913
Skewness	1.206213924
Sum	3.306280421 × 10¹²
Variance	6.179684138 × 10¹⁵
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
219517861	327	0.7%
107434423	232	0.5%
30283594	121	0.2%
137358866	103	0.2%
16098958	96	0.2%
12243051	96	0.2%
61391963	91	0.2%
22541573	87	0.2%
200380610	65	0.1%
7503643	52	0.1%
Other values (37447)	47625	97.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
2438	1	< 0.1%
2571	1	< 0.1%
2787	6	< 0.1%
2845	2	< 0.1%
2868	1	< 0.1%
2881	2	< 0.1%
3151	1	< 0.1%
3211	1	< 0.1%
3415	1	< 0.1%
3563	1	< 0.1%

Value	Count	Frequency (%)
274321313	1	< 0.1%
274311461	1	< 0.1%
274307600	1	< 0.1%
274298453	1	< 0.1%
274273284	1	< 0.1%
274225617	1	< 0.1%
274195458	1	< 0.1%
274188386	1	< 0.1%
274103383	1	< 0.1%
274079964	1	< 0.1%

host_name
Categorical

HIGH CARDINALITY

Distinct	11452
Distinct (%)	23.4%
Missing	21
Missing (%)	< 0.1%
Memory size	3.0 MiB

Michael	417
David	403
Sonder (NYC)	327
John	294
Alex	279
Other values (11447)	47154

Length

Max length	35
Median length	6
Mean length	6.12487212
Min length	1

Characters and Unicode

Total characters	0
Distinct characters	0
Distinct categories	0 ?
Distinct scripts	0 ?
Distinct blocks	0 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	6903 ?
Unique (%)	14.1%

Sample

1st row	John
2nd row	Jennifer
3rd row	Elisabeth
4th row	LisaRoxanne
5th row	Laura

Common Values

Value	Count	Frequency (%)
Michael	417	0.9%
David	403	0.8%
Sonder (NYC)	327	0.7%
John	294	0.6%
Alex	279	0.6%
Blueground	232	0.5%
Sarah	227	0.5%
Daniel	226	0.5%
Jessica	205	0.4%
Maria	204	0.4%
Other values (11442)	46060	94.2%

Length

Histogram of lengths of the category

Value	Count	Frequency (%)
	1120	2.1%
and	625	1.1%
michael	460	0.8%
david	449	0.8%
sonder	423	0.8%
nyc	338	0.6%
john	337	0.6%
alex	330	0.6%
laura	293	0.5%
maria	244	0.4%
Other values (10259)	49968	91.5%

Most occurring characters

Value	Count	Frequency (%)
No values found.

Most occurring categories

Value	Count	Frequency (%)
No values found.

Most frequent character per category

Most occurring scripts

Value	Count	Frequency (%)
No values found.

Most frequent character per script

Most occurring blocks

Value	Count	Frequency (%)
No values found.

Most frequent character per block

neighbourhood_group
Categorical

HIGH CORRELATION

Distinct	5
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	3.0 MiB

Manhattan	21661
Brooklyn	20104
Queens	5666
Bronx	1091
Staten Island	373

Length

Max length	13
Median length	8
Mean length	8.182452193
Min length	5

Characters and Unicode

Total characters	0
Distinct characters	0
Distinct categories	0 ?
Distinct scripts	0 ?
Distinct blocks	0 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	Brooklyn
2nd row	Manhattan
3rd row	Manhattan
4th row	Brooklyn
5th row	Manhattan

Common Values

Value	Count	Frequency (%)
Manhattan	21661	44.3%
Brooklyn	20104	41.1%
Queens	5666	11.6%
Bronx	1091	2.2%
Staten Island	373	0.8%

Length

Histogram of lengths of the category

Pie chart

Value	Count	Frequency (%)
manhattan	21661	44.0%
brooklyn	20104	40.8%
queens	5666	11.5%
bronx	1091	2.2%
staten	373	0.8%
island	373	0.8%

Most occurring characters

Value	Count	Frequency (%)
No values found.

Most occurring categories

Value	Count	Frequency (%)
No values found.

Most frequent character per category

Most occurring scripts

Value	Count	Frequency (%)
No values found.

Most frequent character per script

Most occurring blocks

Value	Count	Frequency (%)
No values found.

Most frequent character per block

neighbourhood
Categorical

HIGH CARDINALITY

Distinct	221
Distinct (%)	0.5%
Missing	0
Missing (%)	0.0%
Memory size	3.2 MiB

Williamsburg	3920
Bedford-Stuyvesant	3714
Harlem	2658
Bushwick	2465
Upper West Side	1971
Other values (216)	34167

Length

Max length	26
Median length	12
Mean length	11.89479497
Min length	4

Characters and Unicode

Total characters	0
Distinct characters	0
Distinct categories	0 ?
Distinct scripts	0 ?
Distinct blocks	0 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	6 ?
Unique (%)	< 0.1%

Sample

1st row	Kensington
2nd row	Midtown
3rd row	Harlem
4th row	Clinton Hill
5th row	East Harlem

Common Values

Value	Count	Frequency (%)
Williamsburg	3920	8.0%
Bedford-Stuyvesant	3714	7.6%
Harlem	2658	5.4%
Bushwick	2465	5.0%
Upper West Side	1971	4.0%
Hell's Kitchen	1958	4.0%
East Village	1853	3.8%
Upper East Side	1798	3.7%
Crown Heights	1564	3.2%
Midtown	1545	3.2%
Other values (211)	25449	52.0%

Length

Histogram of lengths of the category

Value	Count	Frequency (%)
east	6592	8.3%
side	4680	5.9%
williamsburg	3920	5.0%
harlem	3775	4.8%
upper	3769	4.8%
bedford-stuyvesant	3714	4.7%
heights	3586	4.5%
village	3164	4.0%
west	2759	3.5%
bushwick	2465	3.1%
Other values (233)	40681	51.4%

Most occurring characters

Value	Count	Frequency (%)
No values found.

Most occurring categories

Value	Count	Frequency (%)
No values found.

Most frequent character per category

Most occurring scripts

Value	Count	Frequency (%)
No values found.

Most frequent character per script

Most occurring blocks

Value	Count	Frequency (%)
No values found.

Most frequent character per block

latitude
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	19048
Distinct (%)	39.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	40.72894888

Minimum	40.49979
Maximum	40.91306
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	382.1 KiB

Quantile statistics

Minimum	40.49979
5-th percentile	40.646114
Q1	40.6901
median	40.72307
Q3	40.763115
95-th percentile	40.825643
Maximum	40.91306
Range	0.41327
Interquartile range (IQR)	0.073015

Descriptive statistics

Standard deviation	0.05453007806
Coefficient of variation (CV)	0.001338853065
Kurtosis	0.1488446574
Mean	40.72894888
Median Absolute Deviation (MAD)	0.03642
Skewness	0.2371665585
Sum	1991441.956
Variance	0.002973529413
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
40.71813	18	< 0.1%
40.68444	13	< 0.1%
40.69414	13	< 0.1%
40.68634	13	< 0.1%
40.76125	12	< 0.1%
40.68537	12	< 0.1%
40.71171	12	< 0.1%
40.71353	12	< 0.1%
40.76189	12	< 0.1%
40.68683	11	< 0.1%
Other values (19038)	48767	99.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
40.49979	1	< 0.1%
40.50641	1	< 0.1%
40.50708	1	< 0.1%
40.50868	1	< 0.1%
40.50873	1	< 0.1%
40.50943	1	< 0.1%
40.51133	1	< 0.1%
40.52211	1	< 0.1%
40.52293	1	< 0.1%
40.527	1	< 0.1%

Value	Count	Frequency (%)
40.91306	1	< 0.1%
40.91234	1	< 0.1%
40.91169	1	< 0.1%
40.91167	1	< 0.1%
40.90804	1	< 0.1%
40.90734	1	< 0.1%
40.90527	1	< 0.1%
40.90484	1	< 0.1%
40.90406	1	< 0.1%
40.90391	1	< 0.1%

longitude
Real number (ℝ)

HIGH CORRELATION

Distinct	14718
Distinct (%)	30.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	-73.95216961

Minimum	-74.24442
Maximum	-73.71299
Zeros	0
Zeros (%)	0.0%
Negative	48895
Negative (%)	100.0%
Memory size	382.1 KiB

Quantile statistics

Minimum	-74.24442
5-th percentile	-74.00388
Q1	-73.98307
median	-73.95568
Q3	-73.936275
95-th percentile	-73.865771
Maximum	-73.71299
Range	0.53143
Interquartile range (IQR)	0.046795

Descriptive statistics

Standard deviation	0.04615673611
Coefficient of variation (CV)	-0.0006241430961
Kurtosis	5.021646112
Mean	-73.95216961
Median Absolute Deviation (MAD)	0.02485
Skewness	1.284210209
Sum	-3615891.333
Variance	0.002130444288
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
-73.95677	18	< 0.1%
-73.95427	18	< 0.1%
-73.95405	17	< 0.1%
-73.9506	16	< 0.1%
-73.94791	16	< 0.1%
-73.95332	16	< 0.1%
-73.95136	16	< 0.1%
-73.95669	15	< 0.1%
-73.95742	15	< 0.1%
-73.94537	15	< 0.1%
Other values (14708)	48733	99.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-74.24442	1	< 0.1%
-74.24285	1	< 0.1%
-74.24084	1	< 0.1%
-74.23986	1	< 0.1%
-74.23914	1	< 0.1%
-74.23803	1	< 0.1%
-74.23059	1	< 0.1%
-74.21238	1	< 0.1%
-74.21017	1	< 0.1%
-74.20941	1	< 0.1%

Value	Count	Frequency (%)
-73.71299	1	< 0.1%
-73.7169	1	< 0.1%
-73.71795	1	< 0.1%
-73.71829	1	< 0.1%
-73.71928	1	< 0.1%
-73.72173	1	< 0.1%
-73.72179	1	< 0.1%
-73.72247	1	< 0.1%
-73.72435	1	< 0.1%
-73.72581	1	< 0.1%

room_type
Categorical

Distinct	3
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	3.3 MiB

Entire home/apt	25409
Private room	22326
Shared room	1160

Length

Max length	15
Median length	15
Mean length	13.53526945
Min length	11

Characters and Unicode

Total characters	0
Distinct characters	0
Distinct categories	0 ?
Distinct scripts	0 ?
Distinct blocks	0 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	Private room
2nd row	Entire home/apt
3rd row	Private room
4th row	Entire home/apt
5th row	Entire home/apt

Common Values

Value	Count	Frequency (%)
Entire home/apt	25409	52.0%
Private room	22326	45.7%
Shared room	1160	2.4%

Length

Histogram of lengths of the category

Pie chart

Value	Count	Frequency (%)
entire	25409	26.0%
home/apt	25409	26.0%
room	23486	24.0%
private	22326	22.8%
shared	1160	1.2%

Most occurring characters

Value	Count	Frequency (%)
No values found.

Most occurring categories

Value	Count	Frequency (%)
No values found.

Most frequent character per category

Most occurring scripts

Value	Count	Frequency (%)
No values found.

Most frequent character per script

Most occurring blocks

Value	Count	Frequency (%)
No values found.

Most frequent character per block

price
Real number (ℝ_≥0)

Distinct	674
Distinct (%)	1.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	152.7206872

Minimum	0
Maximum	10000
Zeros	11
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	382.1 KiB

Quantile statistics

Minimum	0
5-th percentile	40
Q1	69
median	106
Q3	175
95-th percentile	355
Maximum	10000
Range	10000
Interquartile range (IQR)	106

Descriptive statistics

Standard deviation	240.1541697
Coefficient of variation (CV)	1.572505822
Kurtosis	585.6728789
Mean	152.7206872
Median Absolute Deviation (MAD)	46
Skewness	19.118939
Sum	7467278
Variance	57674.02525
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
100	2051	4.2%
150	2047	4.2%
50	1534	3.1%
60	1458	3.0%
200	1401	2.9%
75	1370	2.8%
80	1272	2.6%
65	1190	2.4%
70	1170	2.4%
120	1130	2.3%
Other values (664)	34272	70.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	11	< 0.1%
10	17	< 0.1%
11	3	< 0.1%
12	4	< 0.1%
13	1	< 0.1%
15	6	< 0.1%
16	6	< 0.1%
18	2	< 0.1%
19	4	< 0.1%
20	33	0.1%

Value	Count	Frequency (%)
10000	3	< 0.1%
9999	3	< 0.1%
8500	1	< 0.1%
8000	1	< 0.1%
7703	1	< 0.1%
7500	2	< 0.1%
6800	1	< 0.1%
6500	3	< 0.1%
6419	1	< 0.1%
6000	2	< 0.1%

minimum_nights
Real number (ℝ_≥0)

SKEWED

Distinct	109
Distinct (%)	0.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	7.029962164

Minimum	1
Maximum	1250
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	382.1 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	1
median	3
Q3	5
95-th percentile	30
Maximum	1250
Range	1249
Interquartile range (IQR)	4

Descriptive statistics

Standard deviation	20.51054953
Coefficient of variation (CV)	2.917590316
Kurtosis	854.0716624
Mean	7.029962164
Median Absolute Deviation (MAD)	2
Skewness	21.82727453
Sum	343730
Variance	420.6826422
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	12720	26.0%
2	11696	23.9%
3	7999	16.4%
30	3760	7.7%
4	3303	6.8%
5	3034	6.2%
7	2058	4.2%
6	752	1.5%
14	562	1.1%
10	483	1.0%
Other values (99)	2528	5.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	12720	26.0%
2	11696	23.9%
3	7999	16.4%
4	3303	6.8%
5	3034	6.2%
6	752	1.5%
7	2058	4.2%
8	130	0.3%
9	80	0.2%
10	483	1.0%

Value	Count	Frequency (%)
1250	1	< 0.1%
1000	1	< 0.1%
999	3	< 0.1%
500	5	< 0.1%
480	1	< 0.1%
400	1	< 0.1%
370	1	< 0.1%
366	1	< 0.1%
365	29	0.1%
364	1	< 0.1%

number_of_reviews
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
ZEROS

Distinct	394
Distinct (%)	0.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	23.27446569

Minimum	0
Maximum	629
Zeros	10052
Zeros (%)	20.6%
Negative	0
Negative (%)	0.0%
Memory size	382.1 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	1
median	5
Q3	24
95-th percentile	114
Maximum	629
Range	629
Interquartile range (IQR)	23

Descriptive statistics

Standard deviation	44.55058227
Coefficient of variation (CV)	1.91413985
Kurtosis	19.52978807
Mean	23.27446569
Median Absolute Deviation (MAD)	5
Skewness	3.690634572
Sum	1138005
Variance	1984.75438
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	10052	20.6%
1	5244	10.7%
2	3465	7.1%
3	2520	5.2%
4	1994	4.1%
5	1618	3.3%
6	1357	2.8%
7	1179	2.4%
8	1127	2.3%
9	964	2.0%
Other values (384)	19375	39.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	10052	20.6%
1	5244	10.7%
2	3465	7.1%
3	2520	5.2%
4	1994	4.1%
5	1618	3.3%
6	1357	2.8%
7	1179	2.4%
8	1127	2.3%
9	964	2.0%

Value	Count	Frequency (%)
629	1	< 0.1%
607	1	< 0.1%
597	1	< 0.1%
594	1	< 0.1%
576	1	< 0.1%
543	1	< 0.1%
540	1	< 0.1%
510	1	< 0.1%
488	1	< 0.1%
480	1	< 0.1%

last_review
Categorical

HIGH CARDINALITY
MISSING

Distinct	1764
Distinct (%)	4.5%
Missing	10052
Missing (%)	20.6%
Memory size	2.8 MiB

2019-06-23	1413
2019-07-01	1359
2019-06-30	1341
2019-06-24	875
2019-07-07	718
Other values (1759)	33137

Length

Max length	10
Median length	10
Mean length	10
Min length	10

Characters and Unicode

Total characters	0
Distinct characters	0
Distinct categories	0 ?
Distinct scripts	0 ?
Distinct blocks	0 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	236 ?
Unique (%)	0.6%

Sample

1st row	2018-10-19
2nd row	2019-05-21
3rd row	2019-07-05
4th row	2018-11-19
5th row	2019-06-22

Common Values

Value	Count	Frequency (%)
2019-06-23	1413	2.9%
2019-07-01	1359	2.8%
2019-06-30	1341	2.7%
2019-06-24	875	1.8%
2019-07-07	718	1.5%
2019-07-02	658	1.3%
2019-06-22	655	1.3%
2019-06-16	601	1.2%
2019-07-05	580	1.2%
2019-07-06	565	1.2%
Other values (1754)	30078	61.5%
(Missing)	10052	20.6%

Length

Histogram of lengths of the category

Value	Count	Frequency (%)
2019-06-23	1413	3.6%
2019-07-01	1359	3.5%
2019-06-30	1341	3.5%
2019-06-24	875	2.3%
2019-07-07	718	1.8%
2019-07-02	658	1.7%
2019-06-22	655	1.7%
2019-06-16	601	1.5%
2019-07-05	580	1.5%
2019-07-06	565	1.5%
Other values (1754)	30078	77.4%

Most occurring characters

Value	Count	Frequency (%)
No values found.

Most occurring categories

Value	Count	Frequency (%)
No values found.

Most frequent character per category

Most occurring scripts

Value	Count	Frequency (%)
No values found.

Most frequent character per script

Most occurring blocks

Value	Count	Frequency (%)
No values found.

Most frequent character per block

reviews_per_month
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
MISSING

Distinct	937
Distinct (%)	2.4%
Missing	10052
Missing (%)	20.6%
Infinite	0
Infinite (%)	0.0%
Mean	1.37322143

Minimum	0.01
Maximum	58.5
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	382.1 KiB

Quantile statistics

Minimum	0.01
5-th percentile	0.04
Q1	0.19
median	0.72
Q3	2.02
95-th percentile	4.64
Maximum	58.5
Range	58.49
Interquartile range (IQR)	1.83

Descriptive statistics

Standard deviation	1.680441995
Coefficient of variation (CV)	1.223722525
Kurtosis	42.49346948
Mean	1.37322143
Median Absolute Deviation (MAD)	0.62
Skewness	3.130188536
Sum	53340.04
Variance	2.823885299
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.02	919	1.9%
1	893	1.8%
0.05	893	1.8%
0.03	804	1.6%
0.16	667	1.4%
0.04	655	1.3%
0.08	596	1.2%
0.09	593	1.2%
0.06	579	1.2%
0.11	539	1.1%
Other values (927)	31705	64.8%
(Missing)	10052	20.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.01	42	0.1%
0.02	919	1.9%
0.03	804	1.6%
0.04	655	1.3%
0.05	893	1.8%
0.06	579	1.2%
0.07	466	1.0%
0.08	596	1.2%
0.09	593	1.2%
0.1	457	0.9%

Value	Count	Frequency (%)
58.5	1	< 0.1%
27.95	1	< 0.1%
20.94	1	< 0.1%
19.75	1	< 0.1%
17.82	1	< 0.1%
16.81	1	< 0.1%
16.22	1	< 0.1%
16.03	1	< 0.1%
15.78	1	< 0.1%
15.32	1	< 0.1%

calculated_host_listings_count
Real number (ℝ_≥0)

Distinct	47
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	7.143982002

Minimum	1
Maximum	327
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	382.1 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	1
median	1
Q3	2
95-th percentile	15
Maximum	327
Range	326
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	32.95251885
Coefficient of variation (CV)	4.612626241
Kurtosis	67.5508883
Mean	7.143982002
Median Absolute Deviation (MAD)	0
Skewness	7.9331739
Sum	349305
Variance	1085.868499
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=47)

Value	Count	Frequency (%)
1	32303	66.1%
2	6658	13.6%
3	2853	5.8%
4	1440	2.9%
5	845	1.7%
6	570	1.2%
8	416	0.9%
7	399	0.8%
327	327	0.7%
9	234	0.5%
Other values (37)	2850	5.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	32303	66.1%
2	6658	13.6%
3	2853	5.8%
4	1440	2.9%
5	845	1.7%
6	570	1.2%
7	399	0.8%
8	416	0.9%
9	234	0.5%
10	210	0.4%

Value	Count	Frequency (%)
327	327	0.7%
232	232	0.5%
121	121	0.2%
103	103	0.2%
96	192	0.4%
91	91	0.2%
87	87	0.2%
65	65	0.1%
52	104	0.2%
50	50	0.1%

availability_365
Real number (ℝ_≥0)

ZEROS

Distinct	366
Distinct (%)	0.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	112.7813273

Minimum	0
Maximum	365
Zeros	17533
Zeros (%)	35.9%
Negative	0
Negative (%)	0.0%
Memory size	382.1 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	45
Q3	227
95-th percentile	359
Maximum	365
Range	365
Interquartile range (IQR)	227

Descriptive statistics

Standard deviation	131.6222889
Coefficient of variation (CV)	1.167057455
Kurtosis	-0.9975340452
Mean	112.7813273
Median Absolute Deviation (MAD)	45
Skewness	0.7634075771
Sum	5514443
Variance	17324.42692
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	17533	35.9%
365	1295	2.6%
364	491	1.0%
1	408	0.8%
89	361	0.7%
5	340	0.7%
3	306	0.6%
179	301	0.6%
90	290	0.6%
2	270	0.6%
Other values (356)	27300	55.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	17533	35.9%
1	408	0.8%
2	270	0.6%
3	306	0.6%
4	233	0.5%
5	340	0.7%
6	245	0.5%
7	219	0.4%
8	233	0.5%
9	193	0.4%

Value	Count	Frequency (%)
365	1295	2.6%
364	491	1.0%
363	239	0.5%
362	166	0.3%
361	111	0.2%
360	102	0.2%
359	135	0.3%
358	180	0.4%
357	95	0.2%
356	78	0.2%

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

The correlation heatmap measures nullity correlation: how strongly the presence or absence of one variable affects the presence of another.

The dendrogram allows you to more fully correlate variable completion, revealing trends deeper than the pairwise ones visible in the correlation heatmap.

First rows

	id	name	host_id	host_name	neighbourhood_group	neighbourhood	latitude	longitude	room_type	price	minimum_nights	number_of_reviews	last_review	reviews_per_month	calculated_host_listings_count	availability_365
0	2539	Clean & quiet apt home by the park	2787	John	Brooklyn	Kensington	40.64749	-73.97237	Private room	149	1	9	2018-10-19	0.21	6	365
1	2595	Skylit Midtown Castle	2845	Jennifer	Manhattan	Midtown	40.75362	-73.98377	Entire home/apt	225	1	45	2019-05-21	0.38	2	355
2	3647	THE VILLAGE OF HARLEM....NEW YORK !	4632	Elisabeth	Manhattan	Harlem	40.80902	-73.94190	Private room	150	3	0	NaN	NaN	1	365
3	3831	Cozy Entire Floor of Brownstone	4869	LisaRoxanne	Brooklyn	Clinton Hill	40.68514	-73.95976	Entire home/apt	89	1	270	2019-07-05	4.64	1	194
4	5022	Entire Apt: Spacious Studio/Loft by central park	7192	Laura	Manhattan	East Harlem	40.79851	-73.94399	Entire home/apt	80	10	9	2018-11-19	0.10	1	0
5	5099	Large Cozy 1 BR Apartment In Midtown East	7322	Chris	Manhattan	Murray Hill	40.74767	-73.97500	Entire home/apt	200	3	74	2019-06-22	0.59	1	129
6	5121	BlissArtsSpace!	7356	Garon	Brooklyn	Bedford-Stuyvesant	40.68688	-73.95596	Private room	60	45	49	2017-10-05	0.40	1	0
7	5178	Large Furnished Room Near B'way	8967	Shunichi	Manhattan	Hell's Kitchen	40.76489	-73.98493	Private room	79	2	430	2019-06-24	3.47	1	220
8	5203	Cozy Clean Guest Room - Family Apt	7490	MaryEllen	Manhattan	Upper West Side	40.80178	-73.96723	Private room	79	2	118	2017-07-21	0.99	1	0
9	5238	Cute & Cozy Lower East Side 1 bdrm	7549	Ben	Manhattan	Chinatown	40.71344	-73.99037	Entire home/apt	150	1	160	2019-06-09	1.33	4	188

Last rows

	id	name	host_id	host_name	neighbourhood_group	neighbourhood	latitude	longitude	room_type	price	minimum_nights	last_review	reviews_per_month	calculated_host_listings_count	availability_365
48885	36482809	Stunning Bedroom NYC! Walking to Central Park!!	131529729	Kendall	Manhattan	East Harlem	40.79633	-73.93605	Private room	75	2	NaN	NaN	2	353
48886	36483010	Comfy 1 Bedroom in Midtown East	274311461	Scott	Manhattan	Midtown	40.75561	-73.96723	Entire home/apt	200	6	NaN	NaN	1	176
48887	36483152	Garden Jewel Apartment in Williamsburg New York	208514239	Melki	Brooklyn	Williamsburg	40.71232	-73.94220	Entire home/apt	170	1	NaN	NaN	3	365
48888	36484087	Spacious Room w/ Private Rooftop, Central location	274321313	Kat	Manhattan	Hell's Kitchen	40.76392	-73.99183	Private room	125	4	NaN	NaN	1	31
48889	36484363	QUIT PRIVATE HOUSE	107716952	Michael	Queens	Jamaica	40.69137	-73.80844	Private room	65	1	NaN	NaN	2	163
48890	36484665	Charming one bedroom - newly renovated rowhouse	8232441	Sabrina	Brooklyn	Bedford-Stuyvesant	40.67853	-73.94995	Private room	70	2	NaN	NaN	2	9
48891	36485057	Affordable room in Bushwick/East Williamsburg	6570630	Marisol	Brooklyn	Bushwick	40.70184	-73.93317	Private room	40	4	NaN	NaN	2	36
48892	36485431	Sunny Studio at Historical Neighborhood	23492952	Ilgar & Aysel	Manhattan	Harlem	40.81475	-73.94867	Entire home/apt	115	10	NaN	NaN	1	27
48893	36485609	43rd St. Time Square-cozy single bed	30985759	Taz	Manhattan	Hell's Kitchen	40.75751	-73.99112	Shared room	55	1	NaN	NaN	6	2
48894	36487245	Trendy duplex in the very heart of Hell's Kitchen	68119814	Christophe	Manhattan	Hell's Kitchen	40.76404	-73.98933	Private room	90	7	NaN	NaN	1	23

Overview

Variables

Common Values

Length

Most occurring characters

Most occurring categories

Most frequent character per category

Control

Most occurring scripts

Most frequent character per script

Common

Most occurring blocks

Most frequent character per block

ASCII

Common Values

Length

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Common Values

Length

Pie chart

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Common Values

Length

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Common Values

Length

Pie chart

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Common Values

Length

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Interactions

Correlations

Spearman's ρ

Pearson's r

Kendall's τ

Cramér's V (φc)

Phik (φk)

Missing values

Sample

First rows

Last rows